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of  an  inverse  pov.er  series  vifu  a continued  fraction;  a method  presented  by 
irof.  stiefel  -ipplying  orthogonal  polynomial  sets  to  the  approximate  solu- 
tion of  sy.u.':ie brie , positive-definite  sj'stetns;  an  elementary  proof  by  Dr. 
Ehlero  of  the  inequality^^ ^ positive 

real;  a description  by  Dr.  Unger  of  the  Jersne-Friedrich  .'lethod  of  evaluating 
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COLIOQUIUM  ON  LINEAR  EQUAnONS 


INIRODUCTION 


During  the  week  5 to  10  October  1953,  a Colloquium  on  linear  Equa- 
tions and  Inequalities  was  held  at  the  Mathematical  Research  Institute  at 
OberwoLfach,  in  the  Black  Forest.  This  Colloquium  had  the  same  informal  and 
pleasant  nature  characteristic  of  such  meetings  at  Oberwolfach,  and  was 
attended  by  about  twenty  mathematicians,  mostly  from  German  and  Swiss  uni- 
versities, A list  of  the  participants  is  given  in  Appendix  I, 

Since  a thorough  description  of  the  Institute,  together  with  a 
detailed  review  of  its  history,  nas  been  given  in  Technical  Report  ONRL-12-52, 
this  will  not  be  repeated.  Briefly,  the  Institute  is  housed  in  a building 
known  as  the  Lorenzenhof,  located  at  Oberwolfach-Walke,  Schwarzwald,  about 
forty  miles  fran  Freiburg  i/Br.  The  history  of  Obei^-olfach  starts  with  the 
organization  by  Professor  W.  Sdss  in  the  middle  of  19liU  of  a Central  Mathe- 
matics Institute  for  the  purpose  of  acting  as  a national  research  and  con- 
sultation center,  Tae  organization  was  divided  into  two  parts,  pure  mathe- 
matics and  applied  mathematics,  and  was  housed  in  the  Lorenzenhof,  The 
policy  of  the  Institute  as  established  very  early  in  its  existence  was  to 
employ  as  many  good  people  as  possible  for  research  along  lines  which  would 
produce  mathematics  and  mathematicians  of  lasting  value  irrespective  of  the 
applications  of  the  moment.  During  the  allied  occupation,  the  Institute 
served  as  a refuge  for  mathematicians  in  distress.  In  the  surroundings  at 
Oberwolfach,  their  interest  in  mathematics  had  an  opportunity  to  be  re- 
awakened. 


Ever  since  the  fall  of  Germary,  the  finances  of  the  Institute 
have  been  rather  precarious.  'Die  receiving  of  the  assignment  from  the  mili- 
tary government  to  prepare  the  FIAT  reviews  on  pure  mathematics  helped, 
principally  in  the  matter  of  food,  and  the  Institute  has  for  the  last 
several  years  received  a small  annual  allocation  from  the  Land  Baden, 
enough  to  cover  rent  and  a few  basic  expenses.  Ihe  situation  of  0berv.’ol- 
fach  is  at  present  rather  clouded  and  it  is  not  at  all  certain  that  it 
will  continue  to  get  even  the  nominal  support  essential  for  its  bare 
existence.  Ihe  reason  for  this  lies  in  a recent  political  change  in  Ger- 
many, the  consolidation  of  two  of  the  Lflnder  into  one,  Ihe  former  LSnder 
of  Baden  and  Wflrttemberg  have  been  combined  into  a single  one,  with,  of 
course,  corresponding  changes  in  the  Departments  of  Education,  The  new 
Ministry  of  Education  has  now  to  be  convinced  anew  of  the  value  of  the 
Institute  to  the  Land  and  to  the  Federal  Republic. 

During  most  of  the  week  of  the  Colloquium  three  meetings  a day 
were  held,  one  in  the  morning,  one  in  the  late  afternoon  and  one  in  the 
early  evening.  Some  of  the  twelve  or  fifteen  contributions  pres'jnted  at 
Obenwolfach  are  discussed  belov/.  In  keeping  with  the  informal  and  "work- 
shop” nature  of  the  meeting,  much  of  the  work  presented  was  tentative  or 
unpolished  in  character  and  much  of  the  time  was  spent  in  critical  dis- 
cussion, No  time  limit  was  ever  imposed. 


AN  APFLICA'ITON  OF  'IrlE  QUOTTENT-DIFr-ERENCE  ALGORITHM 


A quotient-difference  procedure  for  the  investigation  of  eigenvalue 
problems  was  presented  at  the  1953  "leeting  of  Gal.il  in  Aachen  by  Professor  S. 
Stiefel  of  the  E.T.II.  in  Zilrich.  IViis  procedure  was  reported  in  detail  in 
Tbchnical  Report  ONP.L-76-53*  At  Oberwolfach,  Dr.  H.  Rutishauser,  who  col- 
laborated v.’ith  Prof.  Stiefel  in  the  development  of  the  algorithm,  presented 
an  application  of  this  algorithm  to  the  problem  of  obtaining  solutions  to 
linear  equation  systems.  Tliis  application  involves  the  use  of  continued 
fra  c ti ons « 


The  quotient-difference  scliet'ie  starts  with  an  original  set  of 
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If  j;  has  the  form  ^ aj  , then  /i ; ^ .If  the  hi  are 

positive  real,  distifftt,  and  arranged  in  order  of  descending  magniwde,  then 


The  methai  presented  bv  Dr.  Rutishauser  is  based  on  a relationship 
afforded  by  the  o^uotient-difference  algorithm  between  a certain  inverse 
power  series  and  a continued  fraction.  Tliis  relation  is  given 
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This  method  may  in  some  cases  be  useful  for  the  numerical  evaluation  of 
semi-convergent  series. 

lie  particular  application  is  to  the  problem  of  solving  the  equa- 
tion system 
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= r 
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expressed  here  in  matrix  form.  A formAl  solution  is 

..  r * 

convergent  if  A has  only  positive  real  eigenvalues  and  if  ^ is  sufficiently 
large.  If  f!  represents  a particular  element  of  , where 

r 


(XE-A)l'i 


than  the  corresponding  element  of  x is  given  by 
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1=0  A A — \ — /\  ~ 


The  procedure  is  to  pick  a convenient  value  of  /n  , calculate  the 
ft  , carry  out  the  quotient  difference  procedure  on  a particular  element, 
and  to  calculate  the  corresponding  element  of  x through  the  continued 
fraction  expression.  This  continued  fraction  may  be  convergent  even  though 
the  equivalent  inverse  power  series  is  not. 

As  an  example,  the  negative  of  the  Laplace  operator  is  considered 
in  the  usual  finite  difference  form,  applied  to  a square  region  with  homo- 
geneous boundary  conditions 


0—0— 0—0— 0—0 
0 X X X X 0 
0 X X X X 0 
0 X X X X 0 
0 X X X X 0 
O-O-O-O-O-O 


-1 

A = -1  U -1 
-1 


'Phe  quantity  "X  is  chosen  to  be  equal  to  5,  and  the  operator 
expressed 


AE  - A = 1 1 1 
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Tlie  distribution  r for  which  a solution  is  desired  is  chosen 
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for  TKhich 


Tt  = 


ri.  Z 


0 0 

0 0 

0 

1 

0 

0 

3 3 

3 

0 

0 1 
1 1 

0 0 

1 0 

^2  = 

2 

2 

2 

5 

2 

2 

0 

1 

^3  = 

6 12 
11  13 

6 

12 

3 

3 

0 1 

0 0 

2 

2 

2 

0 

6 11 

6 

3 

12 

21 

12 

6 

• • 

• 

• 

32 

Uo 

36 

12 

133 

• 

• 

36 

59 

Uo 

21 

^5  = 

155  211 

133 

• 

28 

36 

32 

12 

. 155 

• 

• 

The  quotient/-difference  procedure  is  applied  to  the  element  for  which 
r was  non-zero. 
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and  X for  that  element  is  expressed 
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The  successive  approximations  to  the  particular  element  of  interest  are 
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It  maj'  be  seen  that,  viith  the  number  of  terms  taken,  no  reasonable 
a;  proxir.'iation  has  been  reached. 


An  alternate  method  that  might  decrease  the  amount  of  calculation 
required  in  the  quotient-difference  algorithm  yjould  be  to  separate  the 
first  m terms,  giving 
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Ihis  type  of  variation  to  Lhe  method  is  necessary  in  case  one  or  more  of 
the  ele.ments  in  the  partial  fraction  expression  are  zero  (or  infinite). 

aOUUirON  OF  bTU.IETRIC,  FOSI 'HVE-^i5FINI  112  5YSTE.‘.S  OF  EQUATIONS  USING 
ORTHOGONAL  FOIOfNOtlALS 

Professor  E.  Stiefel  of  the  E.T.H.  in  Zttrich  presented  a method 
for  obtaining  approximate  solutions  of  finite  systems  of  equations  in 
v.hich  the  matrLx  is  sjnumetric  and  positive  definite.  Tlie  basic  equation 
system  is  expressed 


Ax  ::  k 


(1) 


and  t!;e  eigenvalues  of  tne  uiatrix  are  presumed  to  be  less  than  unj.ty  and 
arranged  iri  order  of  incr-easing  .nagnitude 

O < 4 >\,  <,  < ^ 


Since  an  upper  bound  to  the  eigenvalues  of  a sy^nxetric  matrix  may  be 
found,  t!us  requirement  can  alv.ays  be  satisfied  by  an  appropriate  reduc- 
tion. For  convenience,  the  case  of  distinct  eigenvalues  is  considered. 

An  approxi  : ation  f-cheme  is  envisioned,  in  which  represents 

the  approxi 'nation  to  the  solution,  and  the  residual  vector  is 
defined 


r(  '')  - k - Ax(*’^) 


(2) 


Trie  general  ecpnction  for  inproving  the  solution  is  taken  to  be  of  the 
f orrn 


- x(ff')  r=  Cjj,  (x(i^)  - •+■  a^r^”) 
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from  which  the  equation  for  is  obtained 

j,(m+l)  - - a A)  r(‘«)  - c r(“-^-) 

m .1  ™ 

I\iB  j.rocecs  is  begun  by  setting 


[he  vector  r(*“)  may  be  ex].'ressed  in  the  I'omi 

= R.^^A)  k 
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'..here  R,.^  is  a polynomial  of  dcpree  i in  A.  It  may  be  noted  that 
lv.,(0)=l"l  If  the  vector  k is  exires.sed 

S k^<‘j  «-  V + k^<irt 

in  ter.-ns  of  the  normalized  eigenvectors  e»,  the  vector  r(°^)  is 
expressed 

1^^""'=.  T + (7) 

As  an  example  tae  simple  iteration  scheme  corresponding  to  the 

expansion 

1 V-—  r•^ 

^=o 

is  considered.  rt:is  fits  into  the  general  ccheme  with  cm  -0,  a;a~  1. 

The  polynomial  is  given  simply 

= O-M'” 

It  is  clear  by  considering  a olot  of  that  this  gives  rather  poor 

approximations  for  a given  order  of  iteration  unlc;js  all  the  eigenvalues 
are  close  to  unity. 
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It  is  clear  that  an  approach  using  one  of  the  v/ell-knov/n  sets  of 
polynomials  related  by  recurrence  relations  and  giving  good  representations 
of  other  functions  ir/ithin  a fixed  interval  may  be  used  to  devise  an  intera- 
tion  scheme.  As  an  example,  with  a lower  bound  to  the  eigenvalues, 
the  Tbhebycheff  polynomials  may  be  used,  with 


■— r-  / 


These  functions  are  orthogonal  over  the  interval  ^ to 
ing  function 
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1 with  the  weigh t- 


If  the  eigenvalues  were  known,  a procedure  which  led  to  a residual 
function  ..'nich  had  zeros  at  the  eigenvalues  would  yield  an  exact  solu- 

tion. This  would  be  best  done  for  a given  k by  constructing  a set  of 
orthogonal  polynomials  for  with  the  weighting  function 

- k?  SCA'VW 4-Wv,  5 (X-X«^ 

where  X denotes  the  Dirac  delta  function,  by  means  of  which  would 

automatic  all;''  possess  'tfie  desired  properties.  But  the  orthogonal  property 


(9) 


is  equivalent  in  this  case  to  the  corresponding  orthogonal  properties 
for  the  residual  vectors  themselves.  Thus  the  equations  (U),  together 
•with  the  orthogonality  conditions 


r:  O 

- O 

(10) 

cm  may  be  determiined,  are  able  to 


from  which  the  values  of  am  and 
accomplish  this  construction  rith  no  necessity  for  specific  information 
about  the  actual  eigenvalues.  Tr.is  is  the  principal  result  of  Stiefel's 
contribution.  The  double  orthogonality  condition,  together  with  Eq.  (li) 
ensures  orthogonali'ty  in  general.  The  actual  solution  is  obtained  through 
Eq.  (3). 


It  may  be  isbired  to  use  approximate  information  about  the  eigen- 
value distribution  and  about  the  vector  k in  place  of  the  foregoing 
specialized  procedure.  If  the  density  of  the  eigenvalue  distribution  is 
given  by  |^(^)and  the  component  distribution  of  the  vector  k is  given  by 
k(?v),  the  proper  choice  of  density  function  in  the  orthogonal  polynomial 
procedure  is 


fC\) 


(11) 


With  suitable  choices  for  fCA),  several  of  the  well-known  systems  of 
orthogonal  polynomials  are  obtained. 


COVINA  RI90N  OF  EQUATION-SOLVING  METHODS 

Dr.  H.  Unger  of  the  Institut  ftlr  Praktisohe  Mathematik  in  the 
T.H.  at  Darmstadt  discussed  a number  of  standard  methods  for  solving  the 
equation  system 


Aa  = a 

in  matrtx  notation.  The  general  conclusion  presented  was  that  the  Gauss 
algorithm,  by  which  A is  factored  into  two  triangular  matrices 

A - O ( Q of  form  ^ \ 

n G of  form  ) 

requires  the  least  number  of  numerical  operations. 

Unger  continued  with  a discussion  of  some  of  the  variants  of  the 
Gauss  algorithm. 

(a)  If  the  solution  obtained  is  approximate,  an  improvement  may 
be  obtained  by  obtaining  the  residual 

dio  - a 

solving  the  incremental  equation 

A AXo  = - 

using  the  approximate  triangular  matrices,  correcting  x,  and  repeating 
as  necessary. 

(b)  The  splitting  of  A may  be  accomplished  using  diagonal  matrices 
between  the  triangular  matrices,  in  order  to  decrease  the  number  of  divi- 
sions which  need  to  be  carried  out  in  a numerical  inversion. 


(c)  Ihe  Gauss  algorithm  may  be  carried  out  with  submatrices  in 
place  of  the  usual  elements;  this  requires  the  inverses  of  the  submatrices 
lying  along  the  diagonal,  themselves  obtainable  by  the  Gauss  algorithm. 

(d)  If  a liumber  of  solutions  involving  the  same  matrix  are  to 
be  obtained,  it  ir.  easier  to  carry  out  the  calculation  in  terms  of  the 
inverses  of  the  triangular  matrices 

-i,  = Q 0 Oi: 

than  to  calculate  A“^  and  obtain  directly. 

ELgiEKTARY  PROOF  OF  Ai:  IMEQIJAIJIY 

Dr.  0.  Ehlers  of  the  University  of  Kiel  gave  a simple  proof  of 
the  inequality 


■where  the  a*s  are  all  positive  real.  Noting  that  the  expression  is 
homogeneous,  it  may  be  required  that 

dtClx  • • • • • = \ 

and  it  is  then  necessary  to  prove  that 

Cl,ra».t *■  <\^ 

Ihe  proof  follov.\/  the  method  of  induction, 

Assn.mlng  the  inequali-ty  holds  for  n and  that 

CijUv ^ 

then 

C\,Cly.  (A-J  +-  • • • ^ 

▼mere  a^^  and  &2  bwo  out  of  the  set  of  a's.  Choosing  one  of 

these  greater  than  one  and  tire  other  less  than  one  (a^'=;  1 is  a trivial 
case) . 


combining  the  tvro  inequalities  yields 


-y- 


SOID'nON  OF  UNEi\R  EQUATIONS  BY  COMPLEX  CONTOUR  INTEGRALS 


Dr,  G,  Ehlers  presented  the  solution  of  the  equation  system 

ZA;XBc  = Y 

IS« 

where  the  elements  involved  are  square  matrices  and  the  matrices  B. 
are  comrautable,  Ihe  solution  is 


Y -L  X ^ ^ ^ "y 

A naiT>rJ  J J ZA;Z.  * 2.-?,  ' Xr-Zr 

S|  Ox  Dr 

where  V goes  around  the  entire  spectrum  of  B but  not  around  ary  singularity 

of  8, 

THE  JENNE-FRIEDRICH  l!EmOD  OF  EVALUATING  DETERiiLNANTS 


Dr.  K.  Unger  of  Darmstadt  described  a method  for  the  evaluation 
of  determinants  which,  existent  in  less  available  literature,  is  relatively 
unkncnsn.  The  original  reference  is  a paper  by  K.  Friedrich,  Stuttgart, 
1930,  or  in  a Sonderabdruck  aus  Zeit.  f.  Vermess.-lffesen,  1930,  A second 
reference  is  by  W.  Jenne,  "Zur  Auflttsung  linearer  Gleichungs-systeme**, 
Astronomische  Ilachrichten  273,  73  (19h9).  Tae  method  is  based  upon  a 
lattice-like  graphical  representation  of  the  terms  of  a determinant. 


Each  diagonal  berm  of  the  matrix  or  determinant  is  represented 
by  a point,  for  example  the  terra  a22  by  the  point  2.  Each  conjugate 
pair  of  off-diagonal  terms  is  represented  by  a line  joining  the  corres- 
ponding points,  with  each  term  associated  with  a direction  along  this 
line  J for  exaitiple , 


Additional  notation  is  needed.  Parentheses  are  used  to  denote 
a complete  diagonal  subdeterminant  (one  whose  diagonal  terms  are  diagonal 
terms  of  the  original  determinant)  or  a single  diagonal  term.  The  expres- 
sion 


l^iViTT  • 


is  defined  also. 


Note  that  Irl 
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The  determinant  is  considered  to  be  evaluated  "Kith  respect  to  a certain 
point,  ^ , and  is  given  by  the  expression 


dl  pennu. 


(-0 


v.'here  r is  the  number  of  terms  in  the  | 1 expression,  and  R is  the 

diagonal  sub -determinant  with  terms  in  -X  missing.  The  suranation 

is  taken  over  all  permutations  of  p.  with  any  number  of  other  indices 
(including  none). 


Some  clarification  may  be  brought  about  by  an  example.  The 
complete  b x U determinant 
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is  denoted  by  its  lattice  representation 


Evaluating  with  respect  to  the  point  2, 
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V. 


It  is  evident  that  this  procedure  presents  no  attraction  over 
conventional  methods  in  the  general  .-’-ase.  Its  only  claim  to  usefulness 
is  for  cases  in  vfhich  certain  of  the  off-diagonal  pairs  are  zero,  in 
which  certain  of  the  connecting  lines  of  the  lattice  are  broken.  In  the 
example  above,  if  a,^:r  a,  a.  ^■=.0,  the  results  quoted  above  take 
the  form 


= (a)(0(2 

— 1)  - 0H4^  - la4:iU0(3') 

j 4-  1^34^1  ( 0 4-  \Xif32\  CO. 

i If  the  expan.sion  is  made  relative  to  the  point  1,  the  expression  is 

j simply 

i D = (I)  -(laiU? — 

i In  the  particular  case  of  the  determinant  of  a Jacobi  matrix  the  lattice 

has  the  simple  form 

‘ T-  3 H 5"  n-i 

• — • ^ • _ . . - _♦ 

‘ In  a comparison  of  the  Jenne-Friedrich  Lattice  Method  applied 

' to  the  treatment  of  matrix  and  determinant  problems  with  the  Gauss 

; algorithm,  Dr,  Unger  pointed  out  that  even  in  the  case  of  a Jacobi  matrix 

the  Gauss  procedure  is  better.  Only  in  the  case  for  which  the  sub-  and 
auper-diagonal  terras  are  all  1 or  -1  does  t>u6  Lo  ttice  Method  show 
; aqy  nu.merical  advantage.  Interest  in  the  method  must  probably  depend 

^ on  the  conceptual  picture  it  gives  of  a determinant  and  the  fact  that 

i it  furnishes  a namerical  expansion  symmetric  with  respect  to  the  diagonal. 

I 

' :jeo-3ghl5milcii  series 

Dr,  W.  Hayes  of  ONR  London  presented  a variant  of  the  classical 
SchbLnilch  expeuision  of  an  arbitrary  function  as  a series  of  Bessel 
functions.  In  place  of  the  classical  variation  of  the  argument  pro- 
portional to  an  integer  rr\  the  variation  is  as  -v  where  k 

is  constant.  Series  of  this  type  appear  in  the  theory  of  solutions  of 
the  equation  -o  which  are  periodic  (of  period 

2^^"  , for  example)  in  the  variable  x, 

Hie  function  to  be  expanded  is 

CP 

fui-  icto  JoO<x)  •+-  ^ayr.  Jc  ('ll 

Vv»  = i 


S '■ 
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the  principal  problem  being  to  evaluate  the  coefficients  a in  terms 
of  the  function  f(x).  If  the  function  ^ 

- icxo  ♦ 2-.  coi 

is  knonn,  the  coefficients  are  then  given  directly  by 


J a 


A modification  of  Parseval’s  integral  shows  that  the  functions  f and 
g are  related  by  the  equation 


r 


(cf.  Watson,  G.  N.,  "Theory  of  Bessel  Functions",  Cajnbridge,  19hi;,  Sects. 
2.2,  19.1,  and  19. Ul),  and  the  solution  of  this  integral  equation  is 

A 

gCO  ■=  it®'  COii'C'tlujkf)  il.J 


This  determination  of  g in  terms  of  f completes  the  problem.  Re- 
quirements for  convergence  are  the  same  as  for  classical  SchlBmilch 
series. 


It  may  be  noted  that  k may  be  imaginary,  whereby  in  essence 

the  cos  and  cosh  functions  in  the  above  analysis  are  exchanged.  In  the 

Bessel  function  series  a finite  number  of  terms  are  then  expressible  with 

the  modified  Bessel  function  I in  place  of  J„. 

c o 

As  with  the  classical  SchlOmilch  series,  a null  series  may  be 
obtained.  This  seiies  is 

CD 

^ x)  — o 0<.A<.  TT 

wtc  I 

It  may  be  again  noted  that  k need  not  be  real  in  this  seriss. 
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